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Abstract. We give a generalization of the random matrix ensembles, includ- 
ing all classical ensembles. Then we derive the joint density function of the 
generalized ensemble by one simple formula, which give a direct and unified 
way to compute the density functions for all classical ensembles and various 
kinds of new ensembles. An integration formula associated with the generalized 
ensemble is also given. We also give a classification scheme of the generalized 
ensembles, which will include all classical ensembles and some new ensembles 
which were not considered before. 



1. Introduction 

One of the most fundamental problems in the theory of random matrices is to 
derive the joint density functions for the eigenvalues (or equivalcntly, the measures 
associated with the eigenvalue distributions) of various types of matrix ensembles. 
In his monograph ^2]> Mehta summarized the classical analysis methods by which 
the density functions for various types of ensembles were derived case by case. But 
a systematical method to compute the density functions was desired. 

The first achievement in this direction was made by Dyson jS| , who introduced an 
idea of expressing various kinds of circular ensemble in terms of symmetric spaces 
with invariant probability measures. From then on, guided by Dyson's idea, many 
authors observed new random matrix ensembles in terms of Cartan's classifica- 
tion of Ricmannian symmetric spaces, and obtained the joint density functions for 
such ensembles using the integration formula on symmetric space (see, for exam- 
ple, [51 1^1 151 171 11UI [T51 115p . Here we mention the recent work of Duenez [7J briefly. 
Duenez explored the random matrix ensembles which correspond to infinite families 
of compact irreducible Riemannian symmetric spaces of type I, including circular 
orthogonal and symplectic ensembles and various kinds of Jacobi ensembles. Us- 
ing an integration formula associated with the KAK decomposition of compact 
groups, he obtained the induced measure on the space of eigenvalues associated 
with the underlying symmetric space, and then derived the eigenvalue distribu- 
tion of the corresponding random matrix ensemble. These methods of deriving 
the eigenvalue distributions of random matrix ensembles by means of Riemannian 
symmetric spaces were summarized by the excellent review article of Caselle and 
Magnea UJ. 
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In this paper we provide a generalization of the random matrix ensembles, includ- 
ing all classical ensembles, and then give an unified way to derive the joint density 
function for the eigenvalue distribution by one simple formula. The proof of this 
formula make no use of integration formula. In fact, the corresponding integration 
formula can be derived from this formula as corollary. We also give a classification 
scheme of the generalized random matrix ensembles, which will include all classical 
ensembles and some new ensembles which were not considered before. 

More precisely, Let a : G x X ^ X he a, smooth action of a Lie group G on 
a Riemannian manifold X, preserving the induced Riemannian measure dx. Let 
p(x) be a G-invariant smooth function on X, and consider the measure p(x)dx on 
X, which is not necessary a finite measure. We choose a closed submanifold Y 
of X consisting of representation points for almost all G-orbits in X. The Rie- 
mannian structure on X induces a Riemannian measure dy on Y. Let K be the 
closed subgroup of G which fixes all points in Y, then the map a reduces to a map 
ip : G/K x Y —> X. Suppose there is a G-invariant measure d[i on G/K, and 
suppose dim(G/K xY) = dimX, then it can be proved that the pull back measure 
ip* (p(x)dx) of the measure p(x)dx is of the form tp* (p(x)dx) — d^xdv for some mea- 
sure dv on Y, which is just the measure associated with the eigenvalue distribution. 
The measure dv can be expressed as the form dv(y) = V{y)dy for some function 
V(y) on Y, which is just the joint density function. We write V(y) as the form 
'P{y) = p(y)J{y)i then under some orthogonality condition (that is T y Y _L T y O y 
for almost all y 6 Y), we can compute the factor J(y) by the following formula 

(1.1) J(y) = C\detV v \, 

where C is a constant, which can also be computed explicitly. This formula is the 
main result of this paper, the density function V(y) and the eigenvalue distribution 
dv are determined by it. Here the map ^ y : I — > T y O y is defined by 

where [ is a linear subspace of the Lie algebra g of G such that g = t © [, t is the 
Lie algebra of K . We call the system (G, a, X,p(x)dx, Y, dy) a generalized random 
matrix ensemble. The measure dv and the function V(y) on Y are called generalized 
eigenvalue distribution and generalized joint density function, respectively. Using 
Formula one can derive the joint density function for Gaussian ensemble, 

chiral ensemble, new transfer matrix ensembles, circular ensemble, Jacobi ensemble, 
and some other new generalized ensembles. The precise deriving process will be the 
content of a sequel paper |2] . Here we should point out that the proof of Formula 
is not difficult, but this formula is very effective and available. The derivation 
of all concrete examples in including all classical random matrix ensembles, will 
be based on it. 

Once the eigenvalue distribution dv is derived by Formula Ijl.lfl , under a cover- 
ing condition, we can get the associated integration formula. The Weyl integration 
formula for compact Lie groups, the Harish-Chandra's integration formula for com- 
plex semisimple Lie groups and real reductive groups, the integration formulae on 
Riemannian symmetric spaces of noncompact and compact types which were ap- 
peared in [Jj], as well as their Lie algebra versions are all of particular cases of it 
(see 0). 
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Now let us give a sketch of each section of this paper. In §2 we will develop 
some geometrical preliminaries on the geometry of G-space which will be required 
to establish the generalized ensemble. After presenting four conditions, that is, the 
invariance condition, the transversality condition, the dimension condition, and 
the orthogonality condition, on which the definition of generalized ensemble will be 
based, we will prove in Theorem 12. 51 a primary form of Formula ll.lj l. 

§3 will be devoted to the integration over G-spaces, which will be needed when 
we derive the integration formula associated with the generalized random matrix 
ensemble. Based on the four conditions presented in §2 and a covering condition, 
we will prove an integration formula in Theorem l3.3l which converts the integration 
over a G-space to the integration by first integrating over each G-orbit, and then 
integrating over the orbits space. Two criterions on when the covering condition 
holds will also be given. 

Prepared by the preliminaries of §2 and §3, In §4 we will give the precise definition 
of the generalized random matrix ensemble, as well as the associated generalized 
eigenvalue distribution and generalized joint density function. In Theorem 14. II the 
Formula Ijl.ip will be presented, from which the associated eigenvalue distribution 
measure and density function will be derived for various concrete examples of the 
generalized ensemble in an unified way in [2]. 

In §5 we will give a classification scheme of generalized ensembles, that is, the 
linear ensemble, the nonlinear noncompact ensemble, the compact ensemble, the 
group and algebra ensembles, as well as the pseudo-group and pseudo-algebra en- 
sembles. According to this classification scheme, Gaussian ensemble and chiral en- 
semble are included in linear ensemble, new transfer matrix ensembles is included 
in nonlinear noncompact ensemble, circular and Jacobi ensembles are included in 
compact ensemble. Some new ensembles which were not considered before will also 
be included. 

2. Geometry of G-spaces 

In this section we develop some geometrical preliminaries which will be needed 
to establish our theory of the generalized random matrix ensembles. 

First we make some preparation about measures on manifolds. Let M be an 
n-dimensional smooth manifold. A measure dx on M is called smooth (or quasi- 
smooth) if on any local coordinate chart (U;xi,--- ,x n ) of M, dx has the form 
dx = f(x)dx\ ■ ■ ■ dx n , where / is a smooth function on U and / > (or / > 0), 
dxi ■ ■ ■ dx n is the Lebesgue measure on W 1 . Note that the smooth measures on 
M are unique up to multiplying a positive smooth function on M, so the concept 
of set of measure zero makes sense, which is independent of the choice of smooth 
measure. 

Let M, N be two n-dimensional smooth manifolds, and let ip : M — ► N be a 
smooth map. If dy is a smooth (or quasi-smooth) measure on TV which can be 
expressed locally as dy = f(y)dyi ■ ■ ■ dy n , we can define the pull bake ip*{dy) of dy 
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locally as 



(2.1) <P*(dy) = f{<p{x)) 



•lot [ £ 

ox 



dx\ • ■ ■ dx n . 



It is easily to check that the definition is compatible when we choose different 
coordinate charts, and ip*(dy) is a quasi-smooth measure on M. We can not expect 
<p*(dy) is smooth in general, even if dy is smooth, since ip may have critical points. 
But if ip is a local diffeomorphism and dy is smooth, then <p*{dy) is smooth. 

If M, N are Riemannian manifolds and dx, dy are the associated Riemannian 
measures, then we can express the pull back measure <p*{dy) globally. To do this, 
first we need some comments on the "determinant" of a linear map between two 
different inner product vector spaces of the same dimension. Suppose V, W are two 
n-dimensional vector spaces with inner products. For n vectors v\, ■ ■ ■ , v n £ V, let 
a ij = ( v iT v j) f° r 1 < hj < n 7 an d define Vol(vi, ■ ■ ■ ,v n ) — ^/det(ajj). Note that 
if Vi, ■ ■ ■ , v n is an orthogonal basis, then Vol(vi, ■ ■ ■ , v n ) = \vi \ ■ ■ ■ \v n \. For vectors 
in W we define the same things. Suppose A : V — > W is a linear map, define 



(2.2) \*etA\= V ff^--> Av "\ 

Vol(vi, ■■■ ,v n ) 

where vi, ■ ■ ■ ,v n is a basis of V. It is easily to check that the definition is indepen- 
dent of the choice of the basis v\ , ■ ■ ■ ,v n . In the special case that v\ , ■ ■ ■ , v n is an 
orthogonal basis of V and Av\ , • • • , Av n are mutually orthogonal, then 



(2.3) IdetAI- 1 ^ 11 "-^ 1 



\vi\--- \v, n 



Note that we can only expect the norm of the determinant | det A\ is well defined, 
since the sign "±" depends on the choice of orientations of V and W. 

Proposition 2.1. Suppose M,N are two n-dimensional Riemannian manifolds 
with the associated Riemannian measures dx, dy, repsectively. If tp : M — ^ N is a 
smooth map, then 



(2.4) <p*(dy) = \det(d<p) x \dx. 

Proof. Suppose that in local coordinate charts the Riemannian metrics on M and N 
are ds 2 = T^ i jg i j(x)dxidxj and ds 2 — Yj i jg i j(y)dy i dyj 1 respectively, where gij(x) = 
(w 7 ' a§") an d 9ij(y) = (5^7; ^j)" Then by definition, the Riemannian measures 

dx, dy are dx = \J dot (gij(x))dxi ■ ■ ■ dx n and dy = ^/det (gij(y))dyi ■ ■ ■ dy n . We 
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have 



I det(d(f) a 



Vol 



((#)*(g§r)>- 



■ (<*¥>)*(— 



del 



Vol (£;,■■ 



_d 



) 



1 



det ( 

_dct(s M fe^g«(y(x))) 
det (gij(x)) 



det 



det (gij(x)) 



(dct(||)) 2 dct (&(*>(*))) 



det (ffij (x)) 



Hence 



= ^/det (gij(ip(x))) 



ax 



| det(d<p) :E |^/det (ffjj(x))dxi • • • 
| det(d<^) x |rfx. 



C?Xi • 

dx % 



' dx n 



□ 



Now we come to the main geometric problems which will be concerned in the fol- 
lowing sections. Let G be a Lie group, which acts on an n-dimensional smooth man- 
ifold X. The action is denoted by a : G x X — > X, and we denote <J g (x) = a(g, x). 
Our first goal is, roughly speaking, to choose a representation point in each G-orbit 
O x = {c g (x) : g G G}, and the representation points should depend smoothly on 
the orbits. But in general this aim can only be achieved partially. So suppose we 
have a closed submanifold Y of X, which consists of the representation points of 
the orbits in one's mind, such that Y intersects "almost all" orbits transversally. 
More precisely, we suppose there are closed zero measure subsets X z C X, Y z C Y. 
Let X 1 = X \ X z , Y' = Y \ Y z , and suppose that 



(a) (invariance condition) X' 



U °v 

y eY> 



(b) (transversality condition) 



TyX 



TyOy 8 TyY, Vj, G Y'. 



It is clear that (a) implies Y' = Y n X', and then Y z = Y n X z . Notice that X' 
and Y' are open and dense submanifolds of X and Y, respectively. So Vy G Y', 



TyX' — TyX , TyY' — TyY . 



Let K = {g € G : a g (y) = y,Vy € Y}, then if is a closed subgroup of G. 
For g G G, we denote [gr] = gif in G/if. The map a : G x X — > X reduces 
to a map </? : G/if x Y — > X by <^([g],?/) = cr g {y), and then induces a map 
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G/K x Y' — > X' by restriction, which we also denote by p. By the assumption 
above, cp : G/K X Y' — ► X' is surjective. For x £ X, Let G x = {g £ G : a g (x) = x} 
be the isotropic subgroup associated with x. Then K C G y , Vy £ Y . Let dx, dy be 
smooth measures on X and Y , respectively. We suppose dx is G-invariant. In the 
following we suppose that 

(c) {dimension condition) dimGy = dmxftT, Vy £Y' . 

This means that My £ Y', G y and K have the same Lie algebras, and the only 
difference between G y and K is that G y may have more components than K. Then 
for some y £ Y' , we have 

dimX =dimT y X 

=dimTj,Y" + dimTy O y 
=dimY" + dimG — dimGy 
=dimY" + dimG — dimA". 

So ip is a map between manifolds of the same dimension, and the pull back ip*(dx) 
of dx makes sense. Suppose also that there is a G-invariant smooth measure d\x on 
G/K, then the product measure d[idy on G/K x Y is smooth, so 

(2.5) ip*(dx) = J([g},y)dfidy 
for some J £ C°°(G/K x Y) with J > 0. 

Remark 2.1. The G-invariant smooth measure d/i on G/if exists if and only if 
Aq\k = A/f, where Ac and Ak are the modular functions on G and A", respec- 
tively, see, e.g., Knapp |TI], Section 8.3. For concrete examples in the following 
sections, this condition always hold. 

Proposition 2.2. The smooth function J £ C°°(G/K x Y) is independent of the 
first variable [g] £ G/K. So we can rewrite formula H2.5(l as 

(2.6) tp*(dx) = J(y)dfidy 
where J £ G°°(F) with J > 0. 

Proof. We denote the natural action of h £ G on G/K also by lh, then one can 
easily verify that ah o ip = ip o (Z/j x id). By the G-invariance of cfe and (i/i, we have 

J{\g],y)d^dy 

=(p*(dx) 

=<p* oal(dx) 

= (lh x id)* o ip* (dx) 

=(l h x id)*(J([g],y)dndy) 

=J(h\g],y)(lttdn)xidr(dy)) 

=J{[hg],y)diJ,dy. 

So J([g], y) = J([hg\, y) for all g, h £ G, which means J is independent of the first 
variable. □ 



Corollary 2.3. There exists a quasi-smooth measure dv on Y such that 
(2.7) ip*(dx) = d/idv. 
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The measure dv is given by 

(2.8) du(y) = J{y)dy. 

□ 

The factor J{y) can also be given by more general smooth measures u{x)dx and 
v(y)dy on X and Y. A direct calculation yields the following 

Proposition 2.4. Suppose conditions (a), (b), and (c) hold. If the measures vary 
by dx' = u{x)dx, dy' — v{y)dy, and dji' = \d[i, where u, v are positive smooth 
functions on X, Y, respectively, u is G-invariant, and X is a positive constant, then 
J(y) varies by 

□ 

Now we suppose that there is a Riemannian structure on X such that dx and dy 
are the induced Riemannian measures on X and Y, respectively. We suppose the 
following orthogonality condition holds 

(d) (orthogonality condition) T y Y _L T y O yi Vy G Y' . 

Then we can compute the factor J(y) in a simple way by the following theorem. 

Let [ be a linear subspace of the Lie algebra g of G such that g = 6 © I, where 
{ is the Lie algebra of K. Let it : G — > G/K be the natural projection, then 
(dn) e \i : [ — ► Ti e i(G/K) is an isomorphism. We endow a Riemannian structure on 
G/K such that the associated Riemannian measure is dfi, then it also induces an 
inner product on T^(G/K). For y e Y, we define a linear map ^ y : [ — > T y O y by 

(2.9) = TtLo aexpts{y) ' v?eL 

If y G Y' , then dim [ = dwaT y O y . We choose an inner product on I, and endow the 
inner product on T y O y induced from the Riamannian structure on X. Then the 
"determinants" | det | and | det((e?7r) e |i)| make sense. 

Theorem 2.5. Under the above assumptions, we have 

(2.10) J(y) = C|det*„| ) 
for y G Y' , where C = \ det((d7r) e | [ )|~ 1 is a constant. 
Proof. By the transversality condition (b), the tangent map 

{chp) (le]tV) :T ([e]iV) (G/KxY)^T v X 
of <f at the point ([e],y) (y G Y') can be regarded as 

(dip) ([ely) : T [e] (G/K) T y Y -> T y O y © T„y. 

Denote ^j, = {dip)([ e ] iy )\T< e ,(G/K) '■ T^(G/K) — > T y O y , then it is obvious that 
= ^i/ ° ( c ^ 7r )e|[, and one can easily show that in the matrix form, 



(#)([e]„) = ( ** ° 



s 



Since d/i is the associated Riemannian measure on G/K, the product measure 
dfidy is the the associated Riemannian measure on the product Riemannian mani- 
fold G/K x Y'. By Proposition 12 . II and the orthogonality condition (d), 

J(y) = \det(dip) ([ely) \ 
det 
= 1 det* y | 

= |det(v|/,o((^) e | [ )- 1 )| 
=G|det V y \, 

This proves the theorem. 



(** 


1 




id J 



where C= | det((d 7 r) e | I )|- 



□ 



Remark 2.2. Although formula H2.10[l only hold on Y', since Y' is dense in Y and 
J G C°°(Y), we can get J(y) for all y € Y by smooth continuation. 



3. Integrations over G-spaces 



Occasionally we will be interested in some kinds of integration formulae. In 
this section we give some preliminaries on integrations. The reader who has more 
interest in the eigenvalue distributions of the generalized random matrix ensembles 
may skip this section and go to §4 directly. 

The following proposition generalizes the change of variables formula for multiple 
integration. 

Proposition 3.1. Let ip : M — > N be a smooth map between two n-dimensional 
smooth manifolds M and N, dy a smooth measure on N . If ip is a local diffeomor- 
phism and is a d-sheeted covering map, then for any f 6 C°°(N) with f > or 
with f € i 1 (iV, dy), we have 

(3-1) f f(y)dy=- [ f{v{x))v*{dy). 

JN a JM 

Proof. It is a standard argument using partition of unity, the details is omitted 
here. □ 

Remark 3.1. Formula (|3.1|) seems like a formula which relates degree of a map and 
integration of volume forms on manifold. When M, N are compact and oriented, 
then under the conditions of Proposition 13. II up to a "±" sign, formula l|3.1|l says 
nothing but of this. But, in general, the integration of differential forms is not 
suitable for us. What we will need is a change of variables formula which should 
ignore the negative sign. 

As in the previous section, Let A be a G-space, where A is an n-dimensional 
smooth manifold, G is a Lie group. Then we have the reduced map tp : G/K xF^ 
A. Suppose dx, dy, and d/i are smooth measures on A, Y, and G/K, respectively, 
with dx and dfi to be G-invariant. Our goal is to convert the integration over A 
to the integration over Y. Suppose the conditions (a), (b), and (c) hold. We hope 
the map ip : G/K x Y' — > A' satisfies the conditions as given in Proposition l3.ll 
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Proposition 3.2. Suppose conditions (a), (b) and (c) hold. Then ip : G/K xY' — > 
X' is a local diffeomorphism. 

Proof. Let e be the unit element in G. For ([e],y) S G/K x Y', d(p^ e ] >y \ (0, v) = 
v,Vv € T^T', so T y Y' C /m(d¥>([ e ] )1 ,)). Furthermore, ^|g/atx{j/} : G/K x {y} — > 
O y = G/Gy is a local diffeomorphism, so T^Oj, C Im(dip^ y /). Thus d^Qgjj,) is 
surjective. But dmi(G/K x V) = dimX', so dip^ e ^ y ) is in fact an isomorphism. 
For general ([g],y) G G/K x Y', notice that <p ol g = a g o <p, where l g ([h],y) = 
{[gh},y), so dV([fl],j/) ° ( d 'fl)([e],i/) = (d°5)([e], a ) ° ^([e]^), and dV([e],j/) is isomorphic 
implies d¥>([d,j,) is isomorphic. Thus ip is everywhere regular, and hence is a local 
diffeomorphism. □ 

To make Proposition 13. II available, we endow the following covering condition. 

(e) (covering condition) The map ip : G/K x Y' —* X' is a (i-sheeted covering 
map, with d < +oo. 

Theorem 3.3. Suppose conditions (a), (b), (c). and (e) hold. Then we have 



for all f e C°°(X) with f > or with f G V-{X,dx), where J G C°°(Y~) is 
determined by Formula l\2.b)) . 

Proof. By Proposition 13. 21 ip : G/K x Y' — > X' is a local diffeomorphism. By the 
covering condition (e), <p> is a d-sheeted covering map. So by Proposition 13. II for 
/ € C°°(X) with / > or / G L\X, dx), we have 



Corollary 3.4. Under the same conditions as in the above Theorem, if furthermore 



(3.2) 





□ 



f(°~g{ x )) = f{x),Mg G G, x G X, then 



(3.3) 
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□ 

To make the above conclusion more available, we give some criterions on when 
the map (p : G/K x Y' —> X' is a covering map. 

Proposition 3.5. Let M,N be smooth n- dimensional manifolds. Then an every- 
where regular smooth map tp : M — ► N is a d-sheeted covering map if and only if 
for each y E N , ip~ l (y) has d points. 

Proof. The "=>" part is obvious. We prove the "<=" part. 

For y E N, let ip (jf) = {x\,--- ,Xd}- Since ip is everywhere regular, there 
exists open neighborhood Ui of Xj, i = 1, • • • , d, such that Ui f)Uj — for i ^ j, 
and ifii — (f\ui '■ Ui — » <p{Ui) is a diffeomorphism. Let V = Hi=i P(Ui)> an d 
let Vi = ¥s (V), then ip\y t is also a diffeomorphism onto V. We conclude that 
^\y) = Uti V t . In fact, Vz E ^(V), let z, = tpT 1 ^)), then e ^"H^O)) 
and 0j ^ Zj for i ^ j. But z E </? (y(z)) and |<^ _1 (<p(z))| = <i, this force z = Zi 
for some iq. Hence z E Ui=i^«- Therefore <^ _1 (F) = |Ji=i The Lemma is 
proved. □ 

Corollary 3.6. Suppose conditions (a), (b) and (c) hold. If furthermore 3d E N 
suc/i i/iai Vy E y, 

fij £/ie isotropic subgroup G y = K, (2) \O y ClY'\ = d, 

then if : Gj K x Y' — > X' is a d-sheeted covering map. 

Proof. By Proposition 13.21 tp is a local diffeomorphism. So by the above Proposi- 
tion, we need only to show that for each x E X' , tp~ l {x) has d points. 

For x £ Y', suppose O x D Y' = {yi, ■ ■ ■ ,y<i}- Then there exists gi E G such that 
a gi(yi) = x f° r each i £ {1, • ■ • , d}. Then ([<?;], yi) E </7 _1 (a;). On the other hand, if 
([#],£/) E </?~ 1 (a;), then y = yi for some io £ {1, • • ■ , d}. Now we have c -i(x) = 

o"s(2/io) = x > that is 55V, 1 5^ = K, so [5] = [g io ] and (\g],y) = ([gi },y l() )- Thus 
p~ 1 {x) = {([31], yi), ■ • • , 

In general for x £ X', suppose <Jh(x) E Y' for some h £ G, then the relation 
V _1 ( ''»( a; )) = Ihif^ix)) reduces the general case to the above one. □ 

Both Proposition 13.51 and Corollary 13.61 will be used in the following sections 
when we consider concrete examples. 

Remark 3.2. The converse of Corollary 13.61 is not true. That is, the isotropic 
subgroups G y associated with y E Y' may vary "suddenly" , even if Y' is connected. 
For example, The group SO(n) acts on M.P n smoothly if we regard M.P n as the 
quotient space by gluing the opposite points on the boundary of the closed unit ball 
B n . Let X z be the image of {0}, Y be the image of the segment {(x, 0, ■ • ■ , 0) : \x\ < 
1}, then the conditions (a), (b), (c), and (e) hold. The isotropic subgroup associated 
with the image of a point in Y' which is an interior point of B n is diag(l, SO{n— 1)), 
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but for the image of the point (1, 0, • • • ,0), its isotropic subgroup is diag(±l, ± (n— 
1)) (here O (n — 1) = {g G 0(n — 1) : dct g = ±1} ). Other examples with 
the similar phenomena will appeared in [2] when we consider the group ensemble 
associated with complex semisimple Lie groups. When the phenomena of sudden 
variation of the isotropic subgroups happens, whether we can in general make them 
to be of the same by enlarging the set X z is an open problem. 



Now we are prepared to establish the generalized random matrix ensembles. 

Let G be a Lie group which acts on an n-dimensional smooth manifold X by 
a : G x X — > X. For the convenience, we suppose X is a Riemannian manifold. 
Suppose the induced Riemannian measure dx is G-invariant (note that we do not 
require the Riemannian structure on X to be G-invarinant). Let Y be a closed 
submanifold of X which is endowed the induced Riemannian measure dy, and let 
K = {g e G : a g (y) — y,Vy G Y}. As in §2, we form the map <p : G/K x Y — > X 
by f(\g],y) = °~g(y)- Let X z C X, Y z C Y be closed zero measure subsets of X and 
Y, respectively. Denote X' = X \ X z , Y' = Y\Y Z . We suppose the conditions (a), 
(b), (c), and (d) of §2 hold. For the reader's convenience, we list them below. 



(b) (transversality condition) T y X — T y O y ®T y Y, \/y 6 Y' . 

(c) (dimension condition) dimGj, = dinxA, Vy G Y'. 

(d) (orthogonality condition) T y Y _L T y O y , Vy G Y'. 

Suppose dfi is a G-invariant smooth measure on G/K, and suppose p(x) is a G- 
invariant smooth function on X. Then by Corollary 12.31 there is a quasi-smooth 
measure dv on Y such that 

(4.1) ip* (p(x)dx) — d^idv. 

Definition 4.1. Let the conditions and notations be as above. Then the system 
(G, a, X,p(x)dx, Y, dy) is called a generalized random matrix ensemble. The man- 
ifolds X and Y are called the integration manifold and the eigenvalue manifold, 
respectively. The measure dv on Y determined by (|4.1() is called the generalized 
eigenvalue distribution. 

Recall that in §2 we have defined the map ^ y : I — > T y O y by 



4. Generalized random matrix ensembles 



(a) 



(invariance condition) 




yev 



dt t=o 



Ccxp t£ 



where [ is a linear subspace of g such that = 6 © I. Thanks to the preliminaries 
in §2, we can compute the generalized eigenvalue distribution directly according to 
the following theorem. 
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Theorem 4.1. Let (G,a, X,p(x)dx,Y,dy) be a generalized random matrix ensem- 
ble. Then the generalized eigenvalue distribution dv is given by 

(4.2) du(y) = V{y)dy = p{y)J{y)dy, 
where 

(4.3) J(y) = C\det%\, 
hereC= | det((d7r) e | [) T 1 ■ 

Proof. This follows directly from Proposition 12.21 Corollary 12.31 Proposition 12.41 
and Theorem 12. 51 □ 

The function V(y) = p{y)J(y) determined by formula 14. 2|) is called the gener- 
alized joint density function. 

One of the most fundamental problems in the random matrix theory is to com- 
pute the eigenvalue distribution dv. In our generalized scheme, it is given by for- 
mulae (14. 2|) and l|4.3|) . Note that the power of (|4.3[1 is reflected by the fact that 
it provides a direct and unified method to compute the eigenvalue distributions of 
various kinds of random matrix ensembles. In the sequel paper 2 , we will see that 
all the classical ensembles are included in the generalized scheme, and the corre- 
sponding eigenvalue distributions can be derived from Ij4.2|l and l|4.3J) ■ We will also 
present various kinds of generalized ensemble which were not considered before, 
and compute their eigenvalue distributions explicitly. 

Now we consider the integration formula associated with the generalized random 
matrix ensemble. As in §3, we assume the following covering condition holds. 

(e) {covering condition) The map ip : G/K x Y' — *■ X' is a d-sheeted covering 
map, with d < +oo. 

Theorem 4.2. Let (G,a,X,p(x)dx,Y,dy) be a generalized random matrix ensem- 
ble. Suppose the covering condition (e) holds. Then we have the following integra- 
tion formula 

(4-4) jf f{x)p{x)dx = l -J^ (j^ f(a g (y))df,([g})\ du{y) 

for all f £ C°°(X) with f > or with f G L 1 (X,p(x)dx). If moreover f(a g (x)) = 
f(x),\/g € G,x G X, then 

(4.5) J f(x) P (x)dx = J f(y)du(y). 

Proof. It is obvious by Theorem 13.31 and Corollary 13. 41 □ 

In formula Q4.5[) . if the measure p(x)dx is a probability measure, and we let 
/ = 1, we get y^&JQ j Y dv{y) = 1. So if G/K is compact, we can normalized the 
measure dfi such that \x(G jK) = d, then the generalized eigenvalue distribution dv 
is a probability measure. 

Remark 4.1. The condition / e C°°(X) in Theorem 14. 21 is superfluous. In fact, it 
is sufficient to assume / is measurable. The same is true for Proposition 13. II and 
Theorem 13.31 
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5. A CLASSIFICATION SCHEME OF GENERALIZED ENSEMBLES 

In this section we give a classification scheme of the generalized random matrix 
ensembles, that is, 

(1) Linear ensemble, 

(2) Nonlinear noncompact ensemble, 

(3) Compact ensemble, 

(4) Group ensemble, 

(5) Algebra ensembles, 

(6) Pseudo-group ensemble, 

(7) Pseudo-algebra ensemble. 

First we define the linear ensemble and the nonlinear noncompact ensemble. 
Let G be a real reductive Lie group with Lie algebra q in the sense of Knapp 
jllj . Section 7.2. Then G admits a global Cartan involution 0, which induces 
a Cartan involution 9 of g. Let the corresponding Cartan decomposition of g is 
g = t p. Let K = {g £ G : Q(g) = g}, P = exp(p), then K is a maximal 
compact subgroup of G with Lie algebra t, P is a closed submanifold of G satisfies 
T e P = p. The spaces p and P are invariant under the adjoint action A = Ad|/f and 
the conjugate action a of K, respectively. Let a be a maximal abelian subspace 
of p, and let A be the connected subgroup of G with Lie algebra a. Let M = 
{k G K : Ak(r]) = T],Vr) G a} = {k £ K : it* (a) = a,Va £ ^4}. It can be shown 
that there are Riemannian structures on p and P inducing if-invariant Riemannian 
measures dX on p and dx on P. They also induce Riemannian measures dY on a 
and da on A. There is also a A"-invariant smooth measure dp, on K/M. Let £>i(£) 
and P2{x) be if- invariant positive smooth functions on p and P, then it can be 
proved that the systems (K, A, p , pi(£)dX (£) , a, dY) and (K,a,P,p2{x)dx,A,da) 
are generalized random matrix ensembles, which we called linear ensemble and 
nonlinear noncompact ensemble, respectively. It can be shown that the Gaussian 
ensemble and the chiral ensemble are particular examples of linear ensemble, and 
the new transfer matrix ensembles are particular examples of nonlinear noncompact 
ensemble. 

Next we define the compact ensemble. Let G be a connected compact Lie group 
G with Lie algebra g. Suppose 8 is a global involutive of G with the induced 
involution 8 = d<d of g. Let K = {g £ G : Q(g) = g}, and let p be the eigenspace 
of 9 corresponding the eigenvalue —1. Let P = cxp(p), then P is invariant under 
the conjugate action a of K. It was proved in ^ that P is a closed submanifold 
of G satisfies T e P = p, which is just the identity component of the set {g E G : 
®(flO = 9 1 }- Let a be a maximal abelian subspace of p, and let A be the torus 
with Lie algebra a. There is a Riemannian structure on P induces a A"-invariant 
Riemannian measure dx on P and a Riemannian measure da on A. Let M = {k £ 
K : (Tfc(a) = a, Va £ A}, then there is a if -invariant smooth measure dp: on K/M. 
Let p(x) be a if-invariant positive smooth function on P, then it can be proved 
that the system (K, c, P, p{x)dx, A, da) is a generalized random matrix ensemble, 
which we call it compact ensemble. It can be shown that the circular ensemble and 
the Jacobi ensembles are particular examples of compact ensemble. 
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Let G be an unimodular Lie group G with Lie algebra g. Then there are Rie- 
mannian structures on G and g inducing a cr-invariant Riemannian measure dg on 
G and an Ad-invariant Riemannian measure dX on g, where a denotes the con- 
jugate action of G on itself. Let pi{g) and P2(0 be two function on G and g, 
respectively, which are invariant under the corresponding actions of G. If there 
exists a closed submanifold Y of G such that (G, a, G,p{g)dg, Y, dy) is a generalized 
random matrix ensemble, where dy is the induced Riemannian measure on Y, then 
we call it a group ensemble. And if there exists a closed submanifold rj of g such 
that (G, Ad, 8,p(£)dX(£), rj, dY) is a generalized random matrix ensemble, where 
dY is the induced Riemannian measure on tj, then we call it an algebra ensemble. 
Among all the unimodular Lie groups, the connected compact Lie group and the 
connected complex semisimple Lie group are of particular interest. For a connected 
compact Lie group G, we can let the submanifold Y of G be a maximal torus T of 
G, and let the submanifold rj of g be the Lie algebra of T. For a connected complex 
semisimple Lie group G, we can let the submanifold X) of g be a Cartan subalgebra 
of g, and let the submanifold Y of G be the corresponding Cartan subgroup of 
G. For these cases, it can be proved that the systems (G,a,G,p(g)dg,Y,dy) and 
(G,Ad,g,p(£)dX(£),t),dY) are generalized random matrix ensembles. 

Now we define the pseudo-group ensemble and the pseudo-algebra ensembles, 
which are related to real reductive groups. Let G be a real reductive group with lie 
algebra g. Let 9 be a Cartan involution of g, and let f)i, • • ■ , f) m be a maximal set 
of mutually nonconjugate 9 stable Cartan subalgebras of g with the corresponding 
Cartan subgroups H\, ■ ■ ■ , H m of G. Denote the sets of all regular elements in 
G and g by G r and g r . Let H'a — Hj Pi G r , ^ = f)j n g r . Then it is known 

that G r = U™ iU ?eG <^(#j) (see EJ, Theorem 7.108), g r = \J"Li U aeG Ad*ftj) 
(see Proposition 1.3.4.1), here the symbol "|J" means disjoint union. Each 
U s eG a g(Hj) 1S an open set in G, and each {J geG Ad g (t)'j) is an open set in g. 
Let Gj = VjgQQVgiH'j), Qj — U 3 gg Ad 9 (f)j). It can be shown that some suitable 
Riemannian structures on G and g induce a cr-invariant measure dgj on Gj and 
an Ad-invariant measure dXj on g^- for each j, and they also induce a Riemannian 
measure d/ij on Hj and a Riemannian measure dYj on f)j. It is known that Z(Hj) = 
{g G G : <7 9 (h) = ft,Vft G Hj = {g € G : Ad ff (0 = e,VC G f) 3 }. Let d^-.d/ij 
be G- invariant measures on G/Z(Hj) and G/Hj, respectively. In general, the 
spaces Gj and g^- may have singularities. But this doesn't matter, since they are 
closures of open submanifolds in G and g, whose boundaries have measure zero. 
If we ignore this ambiguity, then it can be proved that (G, a, Gj, dgj, Hj, dhj) and 
(G, Ad, Qj, dXj, t)j, dYj) are generalized random matrix ensembles, which we called 
pseudo-group ensemble and pseudo-algebra ensemble, respectively. 

Due to the generality of the definition, our classification could not exhaust all 
kinds of generalized ensemble. But it would include all kinds of classical random 
matrix ensembles and some new examples of generalized ensembles, which will be 
analyzed explicitly in the sequel paper 
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